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(54) Motion vector searching system 

(57) Herein disclosed is a motion vector searching 
apparatus for searching motion vectors indicative of vis- 
ual motion between a current picture consisting of cur- 
rent picture blocks (TPi) and a reference picture consist- 
ing of search windows each including a set ol reference 
picture blocks (B1 to B9) by calculating a set of distortion 
values and detecting the minimum value from the dis- 
tortion values. The motion vector searching apparatus 
comprises means (100) for outputting current block da- 
ta, means (200) for outputting search window data (Wj), 
and data registering means (300) for registering the 
search window data (Wj) in a searching region (310) 
covering first and second pixels. The data registering 
means (300) has first transmission registers (352) for 
initially registering part ol the search window data (Wj) 
corresponding to the first pixels and second transmis- 
sion registers (382) for initially registering the remaining 
part ol the search window data (Wj) corresponding to 
the second pixels. The motion vector searching appa- 
ratus further comprises transmission controlling means 
(400, 500) for having the search window data (Wj) trans- 
mitted in a predetermined direction from the second 
transmission registers (382) to the first transmission 
registers (352) while the search window data (Wj) is 
transmitted in the predetermined direction, distortion 
computing means (300) for computing the distortion val- 
ues based on the pixel values of one of the current 
blocks and the pixel values of the search window data 
(Wj) registered in order at the firsttransmission registers 
(352), and minimum distortion detecting means (600) for 
detecting the minimum value from the distortion values 
computed by the distortion computing means (300). 
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motion vector "MV" is defined by one ol pixel positions of the reference picture block 3 3, e.g., a pixel position (0 0) in 
the block 33 or the center position of the block 33. Thus, the reference picture block 33 is selected out from the reference 
picture blocks 32 in the search window 31 to be most similar to the current picture block 42 of the current picture 40. 
To select the reference picture block 33 most similar to the current picture block 42, it is necessary to calculate a 

5 set of values each indicative of the similarity between one of the current picture blocks and each of the reference picture 
blocks in the search window 31. The values are calculated as a set of difference values between one of the current 
picture blocks and a set of reference picture blocks in the search window 31, and the minimum value is detected from 
the calculated values to specify the reference picture block most similar to the current picture block 42. Each of the 
calculated values is so-called "distortion" and representative of the difference between one of the current picture blocks 

10 and one of the reference picture blocks in each of the search windows. The minimum value is so^alled "minimum 
distortion' and indicative ofa pair of best matching picture blocks consisting of one of the current picture blocks and 
one of the reference picture blocks. The position of the reference picture block corresponding to the minimum distortion 
value specifies the leading end position of the motion vector "MV in each of the search windows to be representative 
of the position of one of the current picture blocks in the region 41 shown by doted lines and having a size identical to 

is that of the search window 31 in the current picture 40. Each of the distortion values is calculated by a distortion D(k, 
h) function of the form: 




where "a" and "b B respectively indicate pixel values; 

(m+k, n+h) denotes a pixel position in each of search windows; 

(m,n) is a pixel position in each of current picture blocks; 

d(k, h) denotes a local distortion value equivalent to the difference value between the pixel values a(m,n) and b 
(m+k, n+h); 

1 1 1 1 represents a function known as a norm for defining scale measure of motion vectors; and 

M-l 

2 indicates summation from m=0 to M-l . 

m»0 
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Generally, it is effective and simple to have sum of absolute values or square values calculated with the norm 

function. . 

Fig 28 shows a prior art motion vector searching apparatus in combination with Ftg. 29 wherein a search window 
"W includes a plurality of pixels corresponding to K columns of H pixels, and a current picture block TP includes a set 
of pixels corresponding to M columns of N pixels. In other words, the search window "W has a horizontal size K and 
a vertical size H while the current picture block TP a horizontal size M and a vertical size N. In this case, the number 
of the reference picture blocks included in the search window 'W" is equal to (K-M+1 )(H-N+1 ). In Fig. 28, each of the 
pixels in the reference picture blocks 32 is sequentially supplied to the motion vector searching apparatus as shown 
in Fig 28 by a pair of input pixel values b1 (k+m : h+n) and b2(k+m, h+n) to be inputted through input channels SO and 
S1 The motion vector searching apparatus shown in Fig. 28 comprises a calculating circuit 60 of a systolytc array 
structure type motion vector detecting unit 70 and a timing control unit 80. The calculating circuit 60 has three columns 
of three processor elements 61 A, 61 B, 61 C ; 62A, 62B : 62C, 63A, 63B and 63C, two rows of side registers 71 , 72, 73, 
74 75 and 76, and a column of input register units 81 , 82, 83, 84 and 85. The processor elements 61 A to 63A. 61 B to 
63B or 61 C to 63C are distributed in a line and operated to be associated with one another. Each of the pixel values 
of the current block data TP is provided to the processor elements 61 A to 63C in parallel via a data input channel to 
have the pixel values of each of the current picture blocks TP sequentially inputted thereto. The pixel values of the 
search window W 200 inputted to the calculating circuit 60 are respectively shifted to adjacent register units and the 
processor elements to be transmitted through a predetermined three transmission paths. The processor elements 61 A 
and 62C the side register units 71 to 76 and the input register 81 to 35 are vertically connected to have the pixel values 
of each of the reference picture blocks 32 inputted to the processor elements 61 A to 63A, 61 B to 63b, or 61 C to 63C. 
The three groups of processor elements 61 A to 63A, 61 B to 63b, and 61 C to 6X are respectively connected to have 
the inputted pixel values transmitted in the horizontal direction and to transmit the distortion values calculated by each 
group of the processor elements 61 A to 63A, 61 B to 63b, and 61 C to 63C in the horizontal direction in the calculating 
circuit 60 The local distortion values calculated by the processor elements 6 IA to 63 A, 61B to 63B ( or 61C to 63C 
are totaled while they are calculated and transmitted in the horizontal direction. The motion vector detecting unit 70 is 
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ence between each of ihe reference picture blocks and each ofthe current picture blocks, comprising: current block 
data outputting means for outputting current block data representative of the current picture blocks and including a 
plurality of pixel values of the pixels of the current picture blocks: search window data outputting means for outputting 
search window data representative of the search windows and including a plurality of pixel values of the pixels of the 

5 search windows to have each of the search windows include two or more reference picture blocks; data registering 
means for registering the search window data in a searching region with a block size larger than that of each of the 
reference picture blocks, the searching region covering a plurality of first pixels and a plurality of second pixels each 
intervening between the first pixels, the data registering means having a plurality of first transmission registers for 
initially registering part of the search window data corresponding to the first pixels and a plurality of second transmission 

10 registers for initially registering the remaining part of the search window data corresponding to the second pixels; 
transmission controlling means for controlling the first and second transmission registers to have the search window 
data transmitted in a predetermined direction in the searching region, the pixel values of the search window data being 
transmitted from the second transmission registers to the first transmission registers in the searching region white the 
search window data is transmitted in the predetermined direction in the searching region; distortion computing means 

is for computing the distortion values on the basis of the pixel values of one of the current picture blocks represented by 
the current block data and the pixel values of the search window data registered in order at the first transmission 
registers; and minimum distortion detecting means for detecting the minimum value from the distortion values computed 
by the distortion computing means. 

The motion vector searching apparatus may comprise a set of calculators each forming part ofthe distortion com- 

20 puting means and associated with one another to calculate a set of local distortion values based on the pixel values 
of the current picture blocks from the current block data outputting means and the pixel values registered in the first 
transmission registers of the data registering means. In this case, the pixel values of the remaining part of the search 
window data are registered at the second transmission registers while the calculators are operated to calculate the 
local distortion values based on the pixel values of the current picture blocks from the current block data outputting 

25 means and the pixel values of the part of the search window data registered in the first transmission registers of the 
data registering means. 

According to another aspect of the present invention there is provided a motion vector searching apparatus for 
searching a plurality of motion vectors indicative of visual motion between a current picture and a reference picture 
forming part of successive pictures for displaying a dynamic picture image, the current picture consisting of a plurality 

30 of current picture blocks each having a plurality of pixels distributed in N rows and M columns, each of the N and M 
being an integer, the reference picture consisting of a plurality of search windows each including a set of reference 
picture blocks each having a block size the same as that of each of the current picture blocks, each of the motion 
vectors being searched by calculating a set of distortion values and detecting the minimum value from the distortion 
values each of the distortion values being indicative of the difference between each of the reference picture blocks 

35 and each of the current picture blocks, comprising: current block data outputting means for outputting current block 
data representative of the current picture blocks and including a plurality of pixel values of the pixels of the current 
picture blocks- search window data outputting means for outputting search window data representing the search win- 
dows each having a window size of K columns of H pixels and including a plurality of pixel values of the pixels of the 
search windows to have each of the search windows include two or more reference picture blocks; data registering 

40 means for registering the search window data in a searching region with a block size of (H-N+1 ) rows and (K-M+1 ) 
columns larger than the size of each of the reference picture blocks, the searching region covering a plurality of first 
pixels and a plurality of second pixels each intervening between the first pixels, the data registering means having a 
plurality of first transmission registers for initially registering part of the search window data corresponding to the first 
pixels and a plurality of second transmission registers for initially registering the remaining part of the search window 

45 data corresponding to the second pixels; transmission controlling means for controlling the first and second transmis- 
sion registers to have the search window data transmitted in a predetermined direction in the searching region, the 
pixel values of the search window data being transmitted from the second transmission registers to the first transmission 
registers in the searching region while the search window data is transmitted in the predetermined direction in the 
searching region; distortion computing means for computing the distortion values on the basis of the pixel values of 

50 one of the current picture blocks represented by the current block data and the pixel values of the search window data 
registered in order at the first transmission registers; and minimum distortion detecting means for detecting the minimum 
value from the distortion values computed by the distortion computing means. 

According to a further aspect of the present invention there is provided a motion vector searching method of search- 
ing a plurality of motion vectors indicative of visual motion between a current picture and a reference picture forming 

55 part of successive pictures for displaying a dynamic picture image : the current picture consisting of a plurality of current 
picture blocks each having a plurality of pixels distributed in rows and columns, the reference picture consisting of a 
plurality of search windows each including a set of reference picture blocks each having a block size the same as that 
of each of the current picture blocks, each of the motion vectors being searched by calculating a set of distortion values 
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calculating circuit; 

Fig. 1 5 is a block circuit diagram showing a vector data calculating unit forming part of the motion vector searching 
apparatus and adapted to calculate the coordinates of the leading end position ol the motion vector in the search 
window; 

5 Figs. 16(a), 16(b), 16(c)and 16(d) show possible initializing steps performed by the calculating circuit of the motion 

vector searching apparatus; 

Figs. 16(e). 16(f), 16(g) and 16(h) also show initializing steps succeeding to the initializing steps shown in Figs. 
16(a) to 16(d); 

Figs. 16(i) and 16(j) illustrate initializing steps succeeding to the initializing steps shown in Figs. 16(a) to 16(h); 
io Figs. 17(a), 17(b), 17(c)and 17(d) show possible calculating steps performed by the calculating circuit of the motion 

vector searching apparatus; 

Fig. 18 is a timing diagram showing the sequence of the pulses of clock signals generated in the initializing steps 
shown in Figs. 16(a) to 1 6(j), signals for inputting current picture data and search window data : other control signals 
for controlling the processor element, the intermediate register units, the side register units and the input register 
J5 units of the calculating circuit; 

Fig. 19 is a timing diagram showing the sequence of the pulses of clock signals produced in the calculating steps 
shown in Figs. 17(a) to 17(d), signals for controlling the minimum distortion detecting unit and the vector data 
calculating unit and other signals outputted from the motion vector detecting unit; 

Fig. 20 is a plan view of a second embodiment of the motion vector searching apparatus according to the present 
20 invention; 

Fig. 21 is a plan view of a third embodiment of the motion vector searching apparatus according to the present 
invention: 

Fig. 22 is a plan view of a fourth embodiment of the motion vector searching apparatus according to the present 

invention: . . 

25 Fig. 23 is an explanatory view showing the procedure of a prior art prediction coding known as the base inter- 

frame prediction which is utilized for video data compression; 

Fig. 24 is a diagrammatic view showing the procedure of another prior art prediction coding known as the motion 
compensation inter-frame prediction which is utilized for the video data compression; 

Fig. 25 is an explanatory illustration showing a current picture and a reference picture with the procedure of the 
30 prior-art motion compensation according to the block matching method; 

Fig. 26 (a) shows the positional relationship between a plurality of reference picture blocks in the search window 
shown in Fig. 25; 

Fig. 26 (b) shows horizontal and vertical sizes of a current picture block forming part of the current picture shown 
in Fig. 25; 

35 Figs 27 (a) illustrates a pixel position in one of the reference picture blocks shown in Fig. 26 (a). 

Figs. 27 (b) shows a pixel position in the current picture block corresponding to the above pixel position in the 
reference picture block shown in Fig. 27(a). 

Fig. 28 schematically shows a prior-art motion vector searching apparatus having a circuit of the systole array 
structure type; 

40 Fig. 29 is a diagram showing search window data and current block data supplied to the motion vector searching 

apparatus shown in Fig. 28; and 

Fig. 30 is an explanatory view showing part of search window including four integer pels and three hatf-pels inter- 
vening between the integer pels. 

45 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to Figs 1 to 19 of the drawings, a first preferable embodiment of a motion vector searching apparatus 
embodying the present invention is schematically illustrated. The motion vector searching apparatus is roughly de- 
signed to search a plurality of motion vectors indicative of visual motion between a current picture and a reference 
so picture respectively forming part of successive picture for displaying a dynamic picture image. The current picture to 
be predicted consists of a plurally of current picture blocks each having a plurality of pixels which are distributed in 
rows and columns. The reference picture consists of a plurality of search windows each including a set of reference 
picture blocks. Each of the reference picture blocks in the search window has a block size same as that of each of the 
current picture blocks. 

In Figs 1 and 2 the motion vector searching apparatus is shown as comprising a current block data outputtmg 
unit 100, a search window data outputting means 200, a calculating circuit 300, a transmission controlling unit 400 : a 
timing control unit 500 and a motion vector detecting unit 600. 

The current block data outputting unit 100 is equipped with an image data memory for stonng video data ol the 
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from the data register 352 is inputted, a second input port 361b operative to input the current picture data from the 
current block data outputting unit 100 through the current block data input line "X', and an output port 361 c from which 
an output value is outputted. The data subtracting circuit 361 is designed to make a difference value "A-B* between 
the pixel value "A" inputted to the first input port 361a from the data register 352 and the data *B" inputted to the second 

5 input port 361b from the current block data outputting unit 100. The absolute value circuit 362 has a data input port 
362a and a data output port 362b, and is adapted to make an absolute value based on the difference value from the 
data subtracting circuit 361. The local distortion adder 363 has an input port 363a, another input port 363b and an 
output port 363c. This local distortion adder 363 is operated to add the absolute value from the absolute circuit 362 to 
a value preliminarily outputted from the local distortion adder 363 and latched at the distortion register 364. The dis- 

w tortion register 364 is operated in accordance with the clock signal CK1 and the clear signal CL to have a set of local 
distortion values totaled and outputted to the output data selecting unit 370. The pulse of the clock signal CL is generated 
to have the total value of the local distortion values cleared out. This means that four local distortion values are totaled 
by the local distortion adder 363 and the local distortion register 364 to compute a distortion value between each of 
the current picture blocks and each of the reference picture blocks until the clear signal CL is inputted to the local 

15 distortion register 364. 

The output data selecting unit 370 is constituted by a data selector 371 and a data register 372. The data selector 

371 has two input ports 371a and 371 b. an output port 371c and a control signal input ports 371 d. The data register 

372 has a data input port 372a, a data output port 372b and a clock signal port 372c. The data selector 371 is operated 
with the selector control signal "LD" to select from the input data input line Di and the distortion data line connected to 

20 the distortion register 364 one input data line through which the added distortion value is inputted to the data selector 
371 . The pixel value inputted to the data selector 371 is outputted from the output port 371c of the data selector 371 
to the data register 372. The data register 372 consists of a D-ftip-flop which is operated with the clock signal CK2, 
having a timeinterval three time as long as the clock pulses of the clock signal CK1 , so as to latch and output the data 
from the data selector 371 in compliance with the clock signal CK2. 
25 As shown in Figs. 6 (a) and 6 (b), each of the intermediate register units 321 and 322 has three search window 

data input lines YDi, YUi and YLi to which the pixel values of the search window data are transmitted, search window 
data output lines YUo and YDo from which the inputted pixel value of the search window data is outputted in parallel. 
Each of the intermediate register units 323 to 336 shown in Fig. 6 (a) has three search window data input lines YDi, 
YUi and YLi to which the pixel values of the search window data are transmitted, search window data output lines YUo ( 
30 YDo and YLo for outputting the pixel value of the search window data in parallel. Each of the intermediate register 
units 321 to 336 is adapted to register one of the pixel values from the search window data input lines YDi, YUi and YLi. 

Fig 7 shows each of the intermediate register units 323 to 336 as including a data selector 381 and a data register 
382 The data selector 381 has three input ports 381a, 381b and 381c, an output port 381 d and a pair of control signal 
input ports 381 e and 381f . The data register 382 has a data input port 382a, a data output port 382b and a clock signal 
35 port 382c The data selector 381 is operated in accordance with the selector control signals "SU" and 'SL' to select 
from three data input lines YDi, YLi and YUi one line through which one of the pixel values of the search window data 
Wj is inputted to the data selector 381. The pixel value inputted to the data selector 381 is outputted from the output 
port Y of the data selector 381 to the data input port 3 82a of the data register 382. The data register 382 consists of 
a D-flip-flop which is so operated with the clock signal CK as to latch the pixel value from the data selector 381 in 
40 compliance with the clock signal CK and to output the registered pixel value to the search window data output lines 
YUo YDo and YLo in parallel. In case of the intermediate register units 321 and 322, the data register 382 consisting 
of a D-flip-flop is operated with the clock signal CK as to latch the pixel value from the data selector 381 in connection 
with the clock signal CK and to output the registered pixel value to the search window data output lines YUo and YDo. 
The above data registers 352 of the input data selecting units 350 ol the processor elements 311 to 31 9 and the 
45 data register 382 of the intermediate register units 321 to 336 collectively constitutes a searching region 31 0 having a * 
block size larger than that of each of the current and reference picture blocks. In other words, the calculating circuit 
300 has a plurality of first and second transmission registers 352 and 382 as a whole function as data registering 
means for registering the search window data Wj in the searching region 310 with the searching region 310 covering 
a plurality ol first pixels and a plurality of second pixels each intervening between said first pixels. The first transmission 
so registers 352 are operated in accordance with the control signal from the timing control unit 500 and initially registers 
part of said search window data Wj corresponding to said first pixels, while the second transmission registers 382 are 
operated similarly to initially register the remaining part of said search window data Wj corresponding to said second 
pixels The calculating circuit 300 is so constructed as to register the search window data Wj (j=0 f 1 : 2,3. ..) in the search- 
ing region 31 0 with a data block size larger than that of each of the reference picture blocks. In Figs, to 3, the searching 
55 region 31 0 is specified as the pixel block having a horizontal size (K-M+1 ) and a vertical size (H-N+l ) to be represented 
by (x- 0 12, K-M, y; 0.1,2,. ..H-N). The searching region 310 initially covers the plurality of first pixels each hatched 
in Fig. 3 and the plurality of second pixels each intervening between the first pixels in one of horizontal, vertical and 
diagonal directions of the searching region 31 0. 
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inputted. The input, register 410 shown in Fig. 9 (c) has a search window data input line YUi to which the pixel value 
from the input register unit 411 is inputted and a search window data output line YLo from which the inputted pixel 
value of the search window data is outputted, while the input register 416 has a search window data input line YDi to 
which the pixel value from the input register unit 415 is inputted and a search window data output line YLo from which 
the inputted pixel value of the search window data is outputted. 

As shown in Figs. 9(a) and 9 (b). each of the input register units 411 . 41 3 and 41 5 has a data register 441 operative 
to transmit the pixel value of the search window data via the search window data input line YUi and the search window 
data output lines YLo, YUo and YDo. Each of the input register units 41 2 and 41 4 has a data register the same as the 
data register 441 and an input data selector 442 operative to select from the input lines YDi and YUi one input line in 
accordance with the control signals SU and SL The data inputted to the input data setector 442 is outputted to the 
data register 441 , and latched at the data register 441 when the clock pulse of the clock signal CK1 is inputted to the 
data register 441 . The data register 441 may be constituted by a D-flip-flop. 

The transmission controlling unit 400 further comprises a set of side register units corresponding to (N-1) rows of 
(K-M+1 } pixels, for example two rows of five side register units 421 , 422, 423. 424, 425, 426, 427 : 428, 429 and 430. 
As shown Figs. 10 (a) and 10 (b), each of the side register units 422 lo 425 has a data input lines YLi and YUi for 
inputting the pixel values of the search window data, and data output lines YLo and YDo from which the registered 
pixel value is outputted in parallel. The side register 421 shown in Fig. 10 (a) has data input lines YLi and YUi and a 
data output line YDo, while the side register 426 shown in Fig. 1 2 (a) has data input lines YLi and YDi and a data output 
line YUo. Each of the remaining side registers 427 to 430 has a data input lines YLi and YDi to which the pixel values 
of the search window data is transmitted and data output tines YLo and YUo from which the registered pixel value is 
outputted in parallel as shown in Figs. 12 (b) and 13. The pixel values from the input register unit 410 and 416 are 
respectively inputted to the side register units 425 and 430 through the data input line YLi. 

As shown in Fig. 11 , each of the side register units 422 to 425 has a data register 446 operative to sequentially 
latch and transmit the pixel values of the search window data in compliance with the clock pulses of the clock signal 
CK and an input data selector 447 operated in accordance with the selector control signals "SU" and "SL" to select 
from two data input lines YLi and YUi one data input line. On the other hand, in Fig. 13, each of the side register units 
427 to 430 has a data register 448 adapted to sequentially transmit the pixel values of the search window data in 
compliance with the clock pulses of the clock signal CK1 and an input data selector 449 operated with the selector 
control signals "SU" and "SL" to select from two data input lines YLi and YDi one data input line. 

Thus as indicated, each of the side register units 421 to 430 is able to register one of the pixel values from the 
search window data input lines YDi, YUi and YLi and to output the registered pixel value through the data output lines 
YDo YUo and YLo to one of the processor elements 311, 313, 314, 316, 317 and 319, the intermediate register units 
323, 327. 330 and 334, and the adjacent side register units 422 to 425 and 427 to 430. Accordingly, the side register 
units 421 to 430 are able to input the pixel values of the reference picture blocks from the first and second transmission 
registers 352 and 382, and to return the inputted pixel value to the first and second transmission registers 352 and 
382 In the present embodiment, the transmission controlling unit 400 is operative to control the first and second trans- 
mission registers 352 and 382 to have the pixel values of the search window data Wj registered in the first and second 
transmission registers 352 and 382, and simultaneously shifted in the vertical and horizontal directions of the searching 
region 31 0 The above transmission controlling unit 400 is so constructed as to control the first transmission registers 
352 of the processor elements 31 1 to 31 9, the second transmission registers 382 of the intermediate register units 321 
to 336, the input register units 410 to 416 and the side register units 421 to 430 to shift the pixel values of the search 
window data Wj in the vertical direction of the searching region 310, and further to shift the pixel values of the search 
window data Wj registered in part of the above registers 314 to 319, 323 to 336, 411 to 416, 422 to 425 and 427 to 
430 in the horizontal direction ofthe searching region 310 when the pixel values of part of the search window data Wj 
are inputted to the first transmission registers 352 of the processor elements 317 to 319, the second transm.ss.on 
registers 3 82 of the intermediate register units 335 to 336 and the side register unit 430 from the input register units 

411 to 416. ^ 4 

The motion vector searching apparatus further comprises a plurality ol transmission paths, e.g. : three transmission 
paths extending from the data input lines SO, S1 and S2, through which the pixel values of the search window data Wj 
are respectively transmitted in the vertical and horizontal directions of the searching region 310. Each ol the transmis- 
sion paths is constituted by part of the first transmission registers 3 52 of the processors elements 311 to 31 9 and the 
second transmission registers 382 of the intermediate register units 321 to 336 with respective pixel positions ol the 
search window data Wj sequentially transmitted to each of the first transmission registers 352 of the processor elements 
31 1 to 319 each corresponding to a certain pixel position in the searching region 310. 

As shown in Figs 16 (a) to 16 (j) and Figs. 17 (a) to 17 (d), the above transmission controlling unit 400 is designed 
to cooperate with the processor elements 311 to 319 and the intermediate register units 321 to 336 to perform time 
sharing of the processor elements 311 to 31 9 and the intermediate register units 321 to 336 to have the pixel data of 
two or more reference picture blocks, for example the nine reference picture blocks, respectn/ely and sequentially 
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to the pixel position b(0,0) of the search window Wj. while the count value "MVx" outputted from the count value register 
644 is representative otthe horizontal position with respect to the pixel position b(0,0) of the search window Wj. There- 
fore, the count values MVx and MVy are respectively zero when one of the reference picture blocks is positioned at 
the pixel position b(0,0). 

The motion vector detecting unit 600 is so constructed as to produce motion vector data "MV representative ot a 
motion vector and minimum distortion data 'MinDis' representative of a minimum distortion value on the basis of the 
current picture data indicating each of the current picture blocks ol the current picture and the search window data 
representing each of the search windows of the reference picture. The motion vector data "MV" indicates the motion 
vector having a leading end position specified by the count values MVx and MVy and a trailing end in registry with the 
pixel position b(0,0) of the search window Wo. The leading end position of the motion vector represents the position 
of one of the reference picture blocks most similar to one of the current pictures in each of the search windows Wj. 
The minimum distortion data "MinDis- indicates the output value of the minimum distortion register 634 and represent- 
ative of the difference between one of the current picture blocks and one of the reference picture blocks most similar 
to the current picture block. 

As stated above, each of the motion vectors is searched by calculating a set of distortion values and detecting the 
minimum value from the calculated distortion values each indicative of the difference between each of the reference 
picture blocks and each of the current picture blocks. The motion vector data "MV and the minimum distort.on data 
"MinDis" constitute prediction coding data for estimating a visual motion from the reference picture to the current picture 
and representing the current picture with the least amount ol data associated with the search window data preliminarily 
coded. The prediction coding data are transferable in a data communication system such as for example telephone 

system. \ . . 

In the motion vector searching apparatus constructed as above described, the operation process for searching 

motion vectors is performed as follows. 

At first the first and second transmission registers are prepared to form a searching region with a block size larger 
than that of each of the reference picture blocks and a set of transmission paths each extending from one of the data 
input lines "SO" "ST and "S2V The searching region covers a plurality of first pixels and a plurality of second pixels 
each intervening between the first pixels The pixel values of the search window data Wj are transmitted in the vertical 
and horizontal directions of the searching region through the transmission paths. Each of the transmission paths is 
constituted by the first and second transmission registers 352 and 382 with respective pixel positions of the search 
window data Wj sequentially transmitted to one of the first transmission registers 352 corresponding to a certain pixel 
position in the searching region 310. 

The pixel values of the current block data TPi are then sequentially outputted from the current block data outputt.ng 
unit 100 to be provided to the searching region 310 in parallel, while the pixel values ol the search window data Wj are 
transmitted through the three transmission paths to have the pixel values of each of the reference p.cture blocks trans- 
mitted to one of the calculators. In other words, the three groups of pixel values of the search window data Wj are 
outputted from the search window data outputting means 200 to be inputted to the input register units 411 , 413 and 
41 5 respectively. At this time, each of the current picture blocks of the current picture has a plurality of pixels distributed 
in rows and columns, and each of the search windows includes a plurality of reference picture blocks, for example nine 
reference picture blocks. Each of the reference picture blocks has a block size the same as that of each of the current 
picture blocks In this case, a set of distortion values are calculated to be each indicative of the difference between 
each of the reference picture blocks in the search window and one of the current picture blocks, and by detecting the 
minimum value Irom the distortion values to specify the leading end position of each ol the motion vectors. 

The pixel values registered in the input register units are then transmitted to the searching region 310, i.e., the first 
transmission registers 352 of the processor elements 311 to 319 and the second transmission registers 382 of the 
intermediate register units 321 to 336. 

More particularly, the pixel values of the search window data are transmitted to the search window 31 0 tn accord- 
ance with the transmission steps as shown in Figs. 16 (a) to 16 (j) and Figs. 17 (a) to 17 (d). Each of these figures 
shows a window W R having a block size of six columns and seven rows and consisting of the f.rst and second trans- 
mission registers 352 and 382, the input register units 410 to 416 and the side register units 421 to 430. The window 
W R consisting of the above registers is disclosed "register window" hereinlater. 

Initialization Process: 

As shown in Fig. 16 (a) and Fig. 18, three pixel values b(0,1), b(0,3) and b(0,5) are respectwely inputted to the 
input register unit 411 , 41 3 and 415 through the input lines SO, S1 and S2. At this time, the selector controls.gna SU 
is equal to zero i e., the low level, while the selector control signal "SL" is equal lo one i.e., the high level. The selector 
control signal "SL" is then changed to zero to have the pixel values downwardly outputted from the input reg.ster units 
411, 413and 415. 
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mission register 352 of each of the processor elements 311 to 319, and to output the local distortion value to the 
adjoining processor element 311, 312, 313, 314, 315 or 316. In Fig. 17(a), one of the local distortion values outputted 
from the distortion register 354 of the processor element 315 is shown as being an absolute value lb(2,2) - a(0.0)l. 
During the calculation step of the local distortions, each of the selector control signals 'SIT and "SL" is equal to one. 
The selector control signal "SL M is then changed to zero to have the pixel values upwardly shifted in the register window 
W R . In other words, the first transmission registers 3 52 of the processor elements 311 to 319, the second transmission 
registers 382 of the intermediate register units 321 to 336, the input register units 410 to 41 6 and the side register units 
421 to 430 are respectively controlled by the transmission controlling unit 400 and the timing control unit 500 to shift 
the pixel values of the search window data Wj in the vertical direction of the searching region 310, and to shift the pixel 
values registered at the first and second transmission registers 352 and 362 in the horizontal direction of the searching 
region 310 when the pixel values of the search window data Wj are inputted to the first transmission registers 352 of 
the processor elements 317 to 319 and the second transmission registers 382 of the intermediate register units 335 
and 336 from the input register units 411 to 415. In this embodiment, the first and second transmission registers 352 
and 382 are controlled to have the pixel values of the search window data Wj registered in the first and second trans- 
mission registers 352 and 382 and simultaneously shifted in the predetermined direction of the searching region 310. 

Then succeeding three pixel values b(5,1) : b(5,3) and b(5,5) are respectively inputted to the input register unit 
411 41 3 and 41 5 through the input lines SO, S1 and S2 as shown in Fig. 1 7 (b), while a pixel value a(0, 1 ) forming part 
of the current picture data and representative of one of the current picture blocks is outputted from the current block 
data outputting unit 1 00 and provided in parallel to the processor elements 311 to 31 9. At this time, each of the processor 
elements 311 to 319 is operated to calculate a local distortion value based on the inputted pixel value of the current 
block data TPi and the pixel value registered in the first transmission register 352 of each ol the processor elements 
311 to 319. and to output the calculated local distortion value to the adjoining processor element 311 , 312, 313, 314, 
315 or 316 In Fig 17 (b), a total value totaled by the distortion adder 363 and outputted Irom the distortion register 
364 of the processor element 315 is shown as being an absolute value lb(2,2) - a(0.0)l + lb(2,3)-a(0,1)l. During the 
calculation step of the local distortions, the selector control signal "SU" is equal to one. while the selector control signal 
•SL" is equal to zero. Both of the selector control signals "SU" and "SL" are then changed to opposite levels to have 
the pixel values shifted in the horizontal direction in the register window W R . 

And then succeeding three pixel values b(6 ; 1), b(6,3) and b(6.5) are respectively inputted to the input register unit 
411 41 3 and 415 through the input lines SO, S1 and S2 as shown in Fig. 17 (c), while a pixel value a(1,1) forming part 
ol the current picture data and representative of one of the current picture blocks is outputted from the current block 
data outputting unit 100. The pixel value a(1,1) of the current picture data is provided in parallel to the processor 
elements 311 to 319. At this time, each of the processor elements 311 to 319 is operated to calculate a local distortion 
value based on the inputted pixel value of the current block data TPi and the pixel value registered in the first trans- 
mission register 352 of each of the processor elements 311 to 319. and to output the calculated local distortion value 
to the adjoining processor element 311. 312, 313, 314, 315 or 316. In Fig. 17 (c), a total value totaled by the distortion 
adder 363 and outputted from the distortion register 364 of the processor element 315 is shown as an'absolute value 
lb(2 2)-a(0 0)l+lb(2,3)-a(0. 1)1 + 1 b(3.3) - a(1 .1)1. During the calculation step of the local distortions, the selector control 
signal "SIT is maintained at zero, while the selector control signal "SL" is kept to one. The selector control signal "SL" 
is then changed to zero to have the pixel values downwardly shifted in the register window W R . 

After the above steps, the remaining three pixel values b(6.0), b(6.2) and b(6,4) of one ol the search wmdows are 
respectively inputted to the input register unit 411 , 41 3 and 41 5 through the input lines SO, S1 and S2 as shown in Fig. 
1 7 (d) while a pixel value a(1 ,0) forming part of the current picture data and representative of one of the current picture 
blocks is outputted from the current block data outputting unit 100 to be provided in parallel to the processor elements 
311 to 319 At this time, each of the processor elements 311 to 319 is operated to calculate a local distortion value 
based on the pixel value of the current block data TPi and the pixel value registered in the first transmission register 
352 of each of the processor elements 311 to 319, and to output the local distortion value to the adjoining processor 
element 311 312, 313. 314, 315 or 316. In Fig. 17 (d). a total value totaled by the distortion adder 363 and outputted 
from the distortion register 364 of the processor element 315 is shown as an absolute value lb(2,2) - a(0.0)l + lb(2,3) 
- a(0 1 )l + lb(3 3) - a(1 1)1 + lb(3,2) - a(1,0)l. During the calculation step of the local distortions, each of the selector 
control signals "SU" and 'SL' is equal to zero. Both of the selector control signals "SU and "SL' are then changed to 
opposite levels to have the pixel values shifted in the horizontal direction in the register window W R . 

The total values respectively outputted from the processor elements 311 to 31 9 are then transmitted to the motion 
vector detecting unit 600 from the processor elements 311 to 31 9 through the distortion transmission lines DO, D1 and 
D2 shown in Figs 1 and 14, in compliance with the clock pulses of the clock signal CK2 shown in Fig. 19. At this time, 
each of the total values of the local distortion values is equivalent to a distortion value representative of the difference 
between one of the current picture blocks and one of the reference picture blocks. 

When each of the total values of the local distortion values is transmitted to the motion vector detecting unit 600 
from the processor elements 311 to 319 through one of the distortion transmission lines DO, D1 and D2, the minimum 



15 



va P ,u e -BMhep U lseofthes,gnal M.n -soutpu nc9 wt h the output signal "Min" to select 

^ist— ^ 

1rom two input d.stort.on v-lu-jnjj^ J«J*£ the distortion value B ^tered « ^ 
'value "A" from the input data selecto 631 • ^ selector 631 sel rted by the ^ m 

6 33i S thenout pU ttedtothem ln .m U md 1 stort.o 1he ab0 ve cateulation process, and inputted 

On the other hand, each of f „ om tne calculating circurt 300 1 1 i «* jfon countef 64 



25 



30 



vertical position counter 641 ,othe "°^ selector631 .Thecount value CThot men vaUjes 1rom tne 

- ^^^^ 

vectors is varied trom (0,0) to ^ M «^ poX (2,2). Each o. the mcjjj 

40 inputted to the input data sele cto £31 or ch lo the le a dl ng end p ^ r9presente d by 

extends Irom the trailing end port«v P^)of th as a vector hav.ng a lead J.g P ^ seareh wndow . 
"vectors MV is specified in position in registry with •» ^^^i, 'blocks. , 

; e count values Mvx, m and £W*n9 • (0 , 0) ^«^^ P dWort on data "MinDis" jjj* 

, 0 3i9in the searching region310.andeachonn ,„ r9 g isl9r U n.ts 321 to 33b pixe , ^ 



16 



EP 0 713 339 A2 



The search window data Wj has the block size of six columns of size pixels, that is. the search window Wj includes 
36 pixels although the number of the processor elements 31 1 to 3 1 9 is nine. However, the pixel values of search window 
data Wj of 6 columns and 6 rows are able to be transmitted to the processor elements 311 to 319 by the reason that 
the search window data Wj is divided into the first and second pixel data of each of the reference picture blocks, and 
s that the first and second transmission registers 352 and 382 are respectively controlled to perform time sharing of each 
of the first and second transmission registers 352 and 382 and the processor elements 311 to 319 to have the pixel 
data of the first and second pixel data respectively and sequentially transmitted to the first transmission registers 352 
of the processor elements 311 to 319. In this case, each of the pixel values of the current picture blocks is inputted to 
the processor elements 311 to 319 in parallel to repeatedly calculate the local distortion values based on the inputted 
10 pixel value of the current picture block correspond to those of the pixel values registered in the first transmission 
registers 352 of the processor elements 31 1 to 31 9. In addition, the local distortion values calculated by the processor 
elements 31 1 to 31 9 are totaled while the different pixel values of each of the current and reference picture blocks are 
sequentially inputted to the processor elements. The pixel values to be inputted to the processor elements 311 to 319 
and representative of each of the current picture blocks may be changed after the local distortion values are totaled. 
is The aforementioned calculating circuit 300 results in a simple and small scale circuit due to the fact that each of 

the intermediate register units 321 to 336 is smaller and simpler than each of the processor elements 311 to 319. In 
addition, the number of the intermediate register units 321 to 336 should be greater than that of the processor elements 
311 to 319. Accordingly, it is possible to reduce the amount of computation for calculating the distortions to searching 
motion vectors : in comparison with the prior art motion vector searching apparatus designed to implement the so-called 
20 full search block matching , even if the searching region is extensive. 

In Fig. 20, a second embodiment of the motion vector searching apparatus according to the present invention is 
shown as comprising a calculating circuit 1 300 including a plurality of processor elements PE and a plurality of inter- 
mediate register units IP collectively forming a searching region 1310, and a transmission controlling unit 1400 asso- 
ciated with the calculating circuit 1300. Each of the processor elements PE and intermediate register units IP is the 
25 same as one of the above processor elements 31 1 to 31 9 and the intermediate register units 321 to 336 The searching 
region 1310 includes 13 columns of 13 pixels as shown in Fig. 20, wherein first and second columns C11 and C12 are 
included Each of the first and second columns C11 and C1 2 contains at least one first pixel position PI corresponding 
to the first transmission register 352 of each of the processor elements PE and a plurality of second pixel positions P2 
corresponding to the second transmission registers 382 of part of the intermediate register units I P. The totaled number 
so ol the first and second pixel positions P1 and P2 of the first column C11 is equal to that of the second column C12, 
while the number of the first pixel positions P1 of the first column C11 is different from that two of the second column 
C12 In other words, the number of the processor elements PE in the first column C11 is different from the number of 
the processor elements PE in the second column C1 2 in the calculating circuit 300. Further, the searching region 1 31 0 
includes first and second rows R11 and R12 each including the firsl and second pixel positions P1 and P2. The total 
35 number of the first and second pixel positions P1 and P2 in the first row R11 is equal to that of the second row R12, 
while the number of the first pixel positions P1 in the first row Ri 1 is different from the number of the first pixel positions 
P1 in the second row R12. The searching region 1310 further includes a third column C13 consisting ol the second 
pixels P2 and intervening between the first and second columns C11 and C12 in the horizontal direction and a third 
row R1 3 containing the second pixels P2 and intervening between the first and second rows R11 and RI 2 in the vertical 
40 direction The number of the second pixel positions P2 of the third column C13 is the same as the number of the first 
and second pixel positions P1 and P2 of each of the first and second columns C11 and C12. and the number of the 
pixel positions P2 of the third row R1 3 is the same as that of each of the first and second rows R11 and R1 2. 

The calculating circuit 1300 includes a set of calculators each forming part of the processor elements PE and 
respectively operative to calculate the distortion values based on the pixel values of the current picture blocks outputted 
45 from the current block data outputting means and the pixel values latched at the first transmission registers 352 ofthe 
processor elements PE. The numbers of the intermediate register units IP intervening between plural pairs of adjacent 
processor elements PE may be equal to or different from one another. The calculators constituted by the processor 
elements PE are operative in parallel to input the pixel values outputted from the current block data outputting means 
and the pixel values outputted from the search window data outputting unit. The pixel values of one of the current 
so picture blocks are changed to the pixel values of another of the current picture blocks when the certa.n number of local 
distortion values are totaled by the local distortion adders of the PE. 

The transmission controlling unit 1400 is adapted to control the processor elements PE and the intermediate reg- 
ister units I P to have the search window data transmitted in predetermined directions in the searching region 1 31 0 The 
pixel values ofthe search window data are transmitted from the second transmission registers of part of the intermediate 
55 f register units IP to the first transmission registers of the processor elements PE in the searching region 1310 while 
each of the pixel values of the search window data is transmitted in the predetermined directions in the searching 
region 1 310 Specifically, the transmission controlling unit 1400 comprises a set of input register units IR, for example, 
15 input registers corresponding to a column of(H-N+1) pixels and the same as one ol the input registers 410 to 416. 
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Claims 



1 . A motion vector searching apparatus for,searching a plurality of motion vectors indicative of visual motion between 
a current picture and a reference picture forming part of successive pictures for displaying a dynamic picture image, 
said current picture consisting of a plurality of current picture blocks (TPi) each having a plurality of pixels distributed 
in rows and columns, said reference picture consisting of a plurality of search windows each including a set of 
reference picture blocks (B1 to B9) each having a block size the same as that of each of said current picture blocks 
(TPi), each of said motion "vectors being searched by calculating a set of distortion values and detecting the min- 
imum value from said distortion values, each of said distortion values being indicative of the difference between 
each of said reference picture blocks (B1 to B9) and each of said current picture blocks (TPi), comprising: 

current block data outputting means (100) for outputting current block data representative of said current 
picture blocks (TPi) and including a plurality of pixel values (a(m,n)) of said pixels of said current picture blocks 

(TPi); . . . 

search window data outputting means (200) lor outputting search window data (Wj) representative of said 
search windows and including a plurality of pixel values (b1(k+m, h+n), b2(k+m, h+n) and b3(k+m, h+n)) of 
said pixels of said search windows to have each of said search windows include two or more reference picture 
. blocks (B 1 to B9); 

data registering means (300) for registering said search window data (Wj) in a searching region (310) with a 
block size larger than that of each of said reference picture blocks (B1 to B9), said searching region covering 
a plurality of first pixels and a plurality of second pixels each intervening between said first pixels, said data 
registering means (300) having a plurality of first transmission registers (352) for initially registering part of 
said search window data (Wj) corresponding to said first pixels and a plurality of second transmission registers 
for initially registering the remaining part of said search window data (Wj) corresponding to said second pixels; 
transmission controlling means (400 and 500) for controlling said first and second transmission registers (352 
and 382) to have said search window data (Wj) transmitted in a predetermined direction in said searching 
region (310). the pixel values ol said search window data (Wj) being transmitted from said second transmission 
registers (382) to said first transmission registers (352) in order while said search window data (Wj) is trans- 
mitted in said predetermined direction ir\said searching region (310); 

distortion computing means (311 to 31 9) for computing said distortion values on the basis of the pixel values 
of one of said current picture blocks (TPi) represented by said current block data and the pixel values of said 
search window data (Wj) registered in order at said first transmission registers (352); and 
minimum distortion detecting means (600) for detecting the minimum value from said distortion values com- 
puted by said distortion computing means (311 to 319). 

2 A motion vector searching apparatus as set forth in claim 1 , which further comprise a set of calculators (311 to 
319) each forming part of said distortion computing means and associated with one another to calculate a set of 
local distortion values based on the pixel values (a(m, n)) of said current picture blocks (TPi) from sad current block 
data outputting means (100) and the pixel values registered in said first transmission registers (352) of said data 
registering means (300), 

the pixel values of said remaining part of said search window data (Wj) being registered at said second trans- 
mission registers while said calculators are operated to calculate said local distortion values based on the 
pixel values (a(m n)) of said current picture blocks (TPi) from said current block data outputting means (100) 
and the pixel values of said part of said search window data (Wj) registered in said first transmission registers 
(352) of said data registering means (300). 

3 A motion vector searching apparatus as set forth in claim 2, in which said first and second transmission registers 
(352 and 382) are controlled by said transmission controlling means (400 and 500) to perform time shanng of each 
of said calculators (311 to 319) of said distortion computing means (311 to' 31 9) with the pixel values of two or 
more relerence picture blocks (Bl to B9) respectively and sequentially transmitted to each of said first transmission 
registers (352). 

4. A motion vector searching apparatus as set forth in claim 1 , in which said distortion computing means (311 to 31 9) 
is constituted by a set of calculators (361 ) and a set of adders (364), 

said calculators (361) being operative in parallel to input each of the pixel values (8(0,0), a(0,1). a(l,0) and a 
(1,1)) outputted from said current block data outputting means (100) and said pixel values (b(0.0), b(0,2), b 
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the total number of said first and second pixels (P1 and P2) of said first row (R11 ; M21 ) being the same as that of 
said second row (H12; R22), while the number of said first pixels (P1) ol said first row (R11; M1) being different 
from that of said second row (R12 or R22). 

s 11 . A motion vector searching apparatus as set forth in claim 2 or 4. in which each of the pixel values (a(m,n)) of said 
current picture blocks (TPi) being provided to said calculators (311 to 319) in parallel by said current block data 
outputting means (100), said transmission controlling means (400 and 500) controlling said first and second trans- 
mission registers (352 and 382) to have the pixel values of said search window data (Wj) registered in said first 
and second transmission registers (352 and 382) and simultaneously shifted in the vertical and horizontal directions 

to of said searching region (310). 

12. A motion vector searching apparatus as set forth in claim 1 , which further comprises a two dimensional calculating 
circuit (300) ofa systolyic array structure type, said calculating circuit (300) including a plurality of processor ele- 
ments (311 to 319) each having each of said first transmission registers (352) and each of said calculators (361) 

is and a plurality ot intermediate register units (321 to 336) each having each of said second transmission registers 

(382). 

1 3. A motion vector searching apparatus as set forth in claim 1 , which further comprises a two dimensional calculating 
circuit (300) ofa systolyic array structure type, said calculating circuit (300) including three or more columns of 

20 processor elements (311 to 319) and plural columns of intermediate register units ({323 to 327 ) and (330 to 334)), 

each of said processor elements (311 to 319) having each of said first transmission registers (352) and each of 
said calculators (361 ), each of said intermediate register units ((323 to 327 ) and (330 to 334)) having each of said 
second transmission registers (382), the number of said intermediate register units intervening between each pair 
of adjacent processor elements ((311 and 314), (3l2and 315), (313 and 3J 6).. (314and317), (315 and 318) and 

25 (31 6 and 31 9)) being constant. 

1 4. A motion vector searching apparatus as set forth in claim 1 . which further comprises a two dimensional calculating 
circuit (300) of a systolyic array structure type, said calculating circuit (300) including three or more rows of proc- 
essor elements (311 to 319) and plural rows of intermediate register units ((321, 324, 328, 331 and 335) and (322, 

30 326, 329, 333 and 336)), each of said processor elements (311 to 319) having each of said first transmission 

registers (352) and each of said calculators (361), each of said intermediate register units (321, 322, 324, 326, 
328, 329, 331, 333. 335 and 336) having each of said second transmission registers (382), the number of said 
intermediate register units intervening between each pair of adjacent processor elements ((311 and 312), (312 
and 313), (314 and 315), (315 and 316), (317 and 318) and (318 and 319)) being constant. 

35 

1 5. A motion vector searching apparatus as set forth in claim 1 , which further comprises a two dimensional calculating 
circuit (1 300; 2300) of a systolyic array structure type, said calculating circuit (1 300: 2300) including a plurality of 
processor elements (PE) and a plurality of intermediate register units (IR), each of said processor elements (PE) 
having each of said first transmission registers (352) and each of said calculators (361 ), each of said intermediate 

40 register units (IR) having each of said second transmission registers (382), the number of said intermediate register 

units (IR) intervening between a pair of adjacent processor elements (PE) being different from that of said inter- 
mediate register units (IR) intervening between another pair of adjacent processor elements (PE). 

16. A motion vector searching apparatus for searching a plurality ol motion vectors indicative of visual motion between 
' 45 a current picture and a reference picture forming part of successive pictures for displaying a dynamic picture image, 

said current picture consisting of a plurality of current picture blocks (TPi) each having a plurality of pixels distributed 
in N rows and M columns, each of said N and M being an integer said reference picture consisting of a plurality 
of search windows each including a set ol reference picture blocks (B1 to B9) each having a block size the same 
as that ol each of said current picture blocks (TPi), each ol said motion vectors being searched by calculating a 
50 set of distortion values and detecting the minimum value from said distortion values, each of said distortion values 

being indicative of the difference between each of said reference picture blocks (B1 to B9) and each of said current 
picture blocks (TPi), comprising: 

current block data outputting means (100) for outputting current block data representative of said current 
55 picture blocks (TPi) and including a plurality of pixel values of said pixels of said current picture blocks (TPi); 

search window data outputting means (200) for outputting search window data (Wj) representing said search 
windows each having a window size ofK columns of H pixels and including a plurality of pixel values of said 
pixels of said search windows to have each of said search windows include two or more reference picture 
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registers (4 1 1 to 4 1 5) each operative to input and transmit said search window data ( Wj) from said search window 
data outputting means (200) to said first and second transmission registers (352 and 392). and (N-l) rows of (K- 
M+l ) side registers ((421 to 425) or (426 to 430)) each operative to input the pixel values of said reference picture 
blocks (B1 to B9) from one of said first and second transmission registers (352 and 382) and to output the inputted 
pixel value to one of said firs! and second transmission registers (352 and 382), and in which said transmission 
controlling means (400 and 500) controls said first transmission registers (352), said second transmission registers 
(382). said input registers (411 to 41 5) and said side registers (421 to 430) to shift the pixel values of said search 
window data (Wj) in the vertical direction of said searching region (310) and to shift the pixel values registered in 
said first and second transmission registers (352 and 382) in the horizontal direction of said searching region {31 0) 
when the pixel values (b1 (k+m.h-n), b2(k+m,h+n) and b3(k+m,h+n)) of said search window data (Wj) are inputted 
to said first and second transmission registers (352 and 382) from said input registers (411 to 415). 

21. A motion vector searching apparatus as set forth in claim 16, which further comprises a plurality of transmission 
paths (SO, Si and S2) through which said pixel values (b1(k+m.h+n), b2(k+m,h+n) and b3 (k+m,h+n)) of said 
search window data (Wj) are transmitted in the vertical and horizontal directions of said searching region (310), 
each of said transmission paths (SO, SI and S2) being constituted by said first and second transmission registers 
(352 and 382) to have said pixel values of said search window data (Wj) sequentially transmitted to one of said 
first transmission registers (352) corresponding to a certain pixel position in said searching region (310). 

22. A motion vector searching apparatus as set forth in claim 16, in which said searching region (310) has first and 
second columns (C 1 , CV and C2) each containing said first pixels and a third column (C3) consisting ol said second 
pixels and intervening between said first and second columns (C1 : CV and C2) in the horizontal direction of said 
searching region (310), the number of said second pixels of said third column (C3) being the same as that of each 
of said first and second columns (C1, CV and C2). 

23 A motion vector searching apparatus as set forth in claim 16, in which said searching region (310) has first and 
second rows (R1 , RV and R2) each containing said first pixels and a third row (R3) consisting of said second pixels 
and intervening between said first and second rows (R1, RV and R2) in the vertical direction of said searching 
region (310), the number of said second pixels ol said third column (R3) being the same as that of each of said 
first and second rows (R1 : RV and R2). 

24 A motion vector searching apparatus as set forth in claim 1 6, in which said searching region (1310; 231 0) includes 
first and second columns <(C 11 and C12); (C21 and C22)) each consisting of said first and second pixels (P1 and 
P2) the total number of said first and second pixels (P1 and P2) of said first column (C11 ; C21) being the same 
as that of said second column (C 1 2; C22), while the number of said first pixels (P1 ) of said first column (C1 1 ; C21 ) 
being different from that of said second column (C12; C22). 

25 A motion vector searching apparatus as set forth in claim 16. in which said searching region (1 310; 2310) includes 
first and second rows ((R11 and R12); (R21 and R22)) each consisting of said first arid second pixels (P1 and P2). 
the total number of said first and second pixels (Pi and P2) of said first row (R11 , R21 ) being the same as that of 
said second row (R12; R22) ; the number of said first pixels (P 1 ) o1 said first row (R11 ; M21 ) being different from 
that of said second row (R12; R22). 

26 A motion vector searching apparatus as set forth in claim 16 or 18, in which each of the pixel values (a(m ( n)) of 
said current picture blocks (TP.) being provided to said calculators (311 to 319) in parallel by said current block 
data outputting means (100), said transmission controlling means (400 and 500) controlling said first and second 
transmission registers (352 and 382) to have the pixel values of said search window data (Wj) registered in said 
first and second transmission registers (352 and 382) and simultaneously shifted in the vertical and horizontal 
directions of said searching region (310). 

27 A motion vector searching apparatus as set forth in claim 16, which further comprises a two dimensional calculating 
circuit (300) ofa systolyic array structure type, said calculating circuit (300) including a plurality of processor ele- 
ments (31 1 to 31 9) each having each 6f said first transmission registers (352) and each of said calculators (361 ) 
and a plurality of intermediate register units (321 to 336) each having each of said second transmission registers 
(382). 

28 A motion vector searching apparatus as set forth in claim 16, which further comprises a two dimensional calculating 
circuit (3 00) ofa systolyic array structure type, said calculating circuit (300) including three or more columns of 
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32. A motion vector searching method as set forth in claim 31 , which further comprises the steps of: 

preparing a set of calculators (361) respect i very operative to calculate local distortion values on the basis of 
the pixel values of said outputted current picture blocks (TPi) and the pixel values registered in said first trans- 

5 mission registers (352); 

dividing said search window data (Wj) into said part of said search window data (Wj) and said remaining part 
of said search window data (Wj) to be transmitted from said second transmission registers (332) to said first 
transmission registers (352); 
• sequentially inputting said part of said search window data (Wj) and said remaining part of said search window 

w data (Wj) to said first transmission registers (352); 

calculating a set of local distortion values by said calculators (361 ) based on the pixel values of said current 
picture blocks (TPi) and the pixel values of said part of said search window data (Wj) registered in said first 
transmission registers (352); and 

calculating a set of local distortion values by said calculators (361 ) based on the pixel values of said current 
is picture blocks (TPi) and the pixel values of said remaining part of said search window data (Wj) transmitted 

from said second transmission registers (382) and registered in said first transmission registers (352). 

33. A motion vector searching method as set forth in claim 32, which further comprising the step of controlling said 
first and second transmission registers (352 and 3 82) to perform time sharing of each of said calculators (361) to 

20 have said pixel data of two or more reference picture blocks (B1 to B9) respectively and sequentially transmitted 

to one of said first transmission registers (352). 

34. A motion vector searching method as set forth in claim 31 , which further comprises the steps o1: 

25 preparing a set of calculators (361 ) respectively operative to calculate a set of. local distortion values on the 

basis of the pixel values of said outputted current picture blocks (TPi) and the pixel values registered in said 
first transmission registers (352), and a set of adders (364) each operative to total said local distortion values 
calculated by each of said calculators (361); 

sequentially outputting the pixel values (a(m,n)) of each of said current picture blocks (TPi) with respective 
30 positions of said different pixels in each block the same as those of said different pixels registered in said first 

transmission registers (352); 

inputting each of the pixel values of said current picture data in parallel to said calculators (361 ); 
inputting the pixel values from said first transmission registers (352) to said calculators (361) to repeatedly 
calculate said local distortion values on the basis of the pixel values of each of said current picture blocks 
as (TPi) and the pixel values of said reference picture blocks (B1 to B9) in said search window data (Wj) registered 

in said first transmission registers (352); 

totaling said local distortion values each calculated by each of said calculators (361) while said pixel values 
of each of said current and reference picture blocks (TPi and B1 to B9) are sequentially inputted to said cal- 
culators (361); and 

40 changing said pixel values of each of said current picture blocks (TPi) to be inputted to said calculators (361) 

after the local distortion values are totaled. 

35. A motion vector searching method as set forth in claim 31 , which further comprises the steps of: 

45 preparing a set of input registers (41 0 to 41 6) each operative to input and transmit said search window data 

(Wj) to said first and second transmission registers (3 52 and 382), and a plurality of side registers (421 to 
430) each operative to input each of the pixel values ol said reference picture blocks (B1 to B9) from one of 
said first and second transmission registers (352 and 382) and to output the inputted pixel value to each of 
said first and second transmission registers (352 and 382), and 

so controlling said first transmission registers (352), said second transmission registers (382), said input registers 

(410 to 416) and said side registers (421 to 430) to shift the pixel values of said search window data (Wj) in 
the vertical direction of said searching region (310) and to shift the pixel values registered in said first and 
second transmission registers (3 52 and 3 82) in the horizontal direction of said searching region (310) when 
the pixel values (b1(k+m,h+n). b2(k + m,h+n) or b3(k+m t h+n)) of said search window data (Wj) are inputted to 

55 said first and second transmission registers (352 and 382) from said input registers (411 to 416). 

36. A motion vector searching method as set forth in claim 31 , which further comprises the steps of: 
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FIG.6 (a) 
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(54) Motion vector searching system 

(57) Herein disclosed is a motion vector searching 
apparatus for searching motion vectors indicative of vis- 
ual motion between a current picture consisting ol cur- 
rent picture blocks (TPi) and a reference picture consist- 
ing ol search windows each including a set of reference 
picture blocks (B1 to B9) by calculating a set of distortion 
values and detecting the minimum value from the dis- 
tortion values. The motion vector searching apparatus 
comprises means (100) for outputting current block da- 
ta, means (200) for outputting search window data (Wj), 
and data registering means (300) for registering the 
search window data (Wj) in a searching region (310) 
covering first and second pixels. The data registering 
means (300) has first transmission registers (352) for 
initially registering part of the search window data (Wj) 
corresponding to the first pixels and second transmis- 



sion registers (382) for initially registering the remaining 
part of the search window data (Wj) corresponding to 
the second pixels. The motion vector searching appa- 
ratus further comprises transmission controlling means 
(400, 500) for having the search window data (Wj) trans- 
mitted in a predetermined direction from the second 
transmission registers (382) to the first transmission 
registers (352) while the search window data (Wj) is 
transmitted in the predetermined direction, distortion 
computing means (300) for computing the distortion val- 
ues based on the pixel values of one of the current 
blocks and the pixel values of the search window data 
(Wj) registered in order at the first transmission registers 
(352), and minimum distortion detecting means (600) for 
detecting the minimum value from the distortion values 
computed by the distortion computing means (300). 
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